Virtual dance and music environment using motion capture
نویسندگان
چکیده
We present a multimedia project incorporating music and dance. We used a 3D motion capture system to produce animations from dance and generate the soundtrack from the dancer's movements. Movement analysis is performed to extract the important features of a particular gesture. Based on the parameters chosen from this analysis, various mappings between gesture and music are applied. In particular, the motion capture data is used to trigger and modify the timbre of sounds. This paper describes the method and the interactive environment that are under development.
منابع مشابه
An automated time and hand motion analysis based on planar motion capture extended to a virtual environment
In the context of industrial engineering, the predetermined time systems (PTS) play an important role in workplaces because inefficiencies are found in assembly processes that require manual manipulations. In this study, an approach is proposed with the aim to analyze time and motions in a manual process using a capture motion system embedded to a virtual environment. Capture motion system trac...
متن کاملDance-the-Music: an educational platform for the modeling, recognition and audiovisual monitoring of dance steps using spatiotemporal motion templates
In this article, a computational platform is presented, entitled “Dance-the-Music”, that can be used in a dance educational context to explore and learn the basics of dance steps. By introducing a method based on spatiotemporal motion templates, the platform facilitates to train basic step models from sequentially repeated dance figures performed by a dance teacher. Movements are captured with ...
متن کاملSynthesis of Variable Dancing Styles Based on A Compact Spatiotemporal Representation of Dance
Dance as a complex expressive form of motion is able to convey emotion, meaning and social idiosyncrasies that opens channels for non-verbal communication, and promotes rich cross-modal interactions with music and the environment. As such, realistic dancing characters may incorporate crossmodal information and variability of the dance forms through compact representations that may describe the ...
متن کاملImmersive performance training tools using motion capture technology
Traditionally, students can undergo performance training by imitating teachers’ motions and improving their moves by following teachers’ advice. However, teachers are not always available and there is a lack of effective self-training tools. In this paper, we propose an immersive performance training system with motion capture technology. Our aim is to provide a virtual training environment for...
متن کاملLearning to Dance through Interactive Evolution
A relatively rare application of artificial intelligence at the nexus of art and music is dance. The impulse shared by all humans to express ourselves through dance represents a unique opportunity to artificially capture human creative expression. In particular, the spontaneity and relative ease of moving to the music without any overall plan suggests a natural connection between temporal patte...
متن کامل